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DETAILED ACTION 

Continued Examination Under 37 CFR 1.114 

1 . A request for continued examination under 37 CFR 1.114, including the fee set 
forth in 37 CFR 1.17(e), was filed in this application after final rejection. Since this 
application is eligible for continued examination under 37 CFR 1.114, and the fee set 
forth in 37 CFR 1 .17(e) has been timely paid, the finality of the previous Office action 
has been withdrawn pursuant to 37 CFR 1.114. Applicant's submission filed on June 
30, 2009 has been entered. 

Response to Arguments 

2. Applicant's arguments with respect to claims 1-4 and 7-57 have been considered 
but are moot in view of the new ground(s) of rejection. Furthermore, the new ground(s) 
of rejection is based on claim amendments and a different interpretation of a previously 
applied reference. 

Claim Rejections - 35 USC § 103 

3. The following is a quotation of 35 U.S.C. 1 03(a) which forms the basis for all 
obviousness rejections set forth in this Office action: 

(a) A patent may not be obtained though the invention is not identically disclosed or described as set 
forth in section 102 of this title, if the differences between the subject matter sought to be patented and 
the prior art are such that the subject matter as a whole would have been obvious at the time the 
invention was made to a person having ordinary skill in the art to which said subject matter pertains. 
Patentability shall not be negatived by the manner in which the invention was made. 
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4. Claims 1-4 and 7-57 are rejected under 35 U.S.C. 103(a) as being unpatentable 
over Subramanian et al. (U.S. Patent 2005/0018775) in view of Griffits (U.S. Patent 
6,262,776). 

Regarding claim 1, Subramanian et al. discloses a method, comprising: 
determining, determining by a computing device, whether two or more samples 
of a presentation are processed by a first component of a pipeline at an expected 
time, the two or more samples comprising a first sample and a later processed 
second sample, wherein the determining comprises determining a first timing 
error for the first sample and a second timing error for the second sample 
(paragraph [0049] - the presentation time stamp for every B-picture is compared 
to the system time clock value, thereby meaning that two or more samples are 
processed since every B-picture is sampled and each one has its own result); 
and requesting, by a computing device, a second component of the pipeline to 
alter the manner in which the second component processes a portion of the 
presentation if the at least one sample is not processed at the expected time 
(paragraph [0049] - if the PTS value and the STC value differ by more than a 
predetermined threshold, the video decoder drops the B-picture without 
decoding). However, Subramanian et al. fails to disclose that the second 
component of the pipeline alters the manner in which the second component 
processes a portion of the presentation of the presentation when the two or more 
samples are not processed at the expected time and when the first timing error is 
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greater than the second timing error, wherein the portion of the presentation 
comprises at least one succeeding sample to the two or more samples. 

Referring to the Griffits reference, Griffits discloses a method for 
maintaining synchronization between audio and video comprising: determining 
whether at least two sample of a presentation is processed by a first component 
of a pipeline at an expected time; and wherein the second component of the 
pipeline alters the manner in which the second component processes a portion of 
the presentation of the presentation when the two or more samples are not 
processed at the expected time and when the first timing error is greater than the 
second timing error, wherein the portion of the presentation comprises at least 
one succeeding sample to the two or more samples (Fig. 11 - the next sample is 
altered; col. 18, lines 11 -37 -frames are monitored and once the decoder gets 
too far behind then frames are altered in order to allow the decoder to 
resynchronize the video and audio; col. 18, lines 39-56 - various statistics on the 
timing of frames are monitored; col. 19, lines 11-36 - four situations are 
determined that include frames being too early and too late. Furthermore, the 
first and second samples are being compared in the fact that the system is 
monitoring the process of the decoding and once the frames are too early or too 
late other frames are altered. Griffits discloses both situations of the first timing 
error being greater or less than the second timing error since Griffits covers both 
the fact that frames can be too early and too late). 
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Therefore, it would have been obvious to one of ordinary skill in the art at 
the time the invention was made to have altered the succeeding sample in the 
presentation as disclosed by Griffits in the method disclosed by Subramanian et 
al. in order to display the samples at the correct times as well as to maintain a 
synchronization between audio and video data so that the viewer can not detect 
any problems when synchronizing the video and audio). 

Regarding claim 2, Subramanian et al. in view of Griffits discloses all the 
limitations as previously discussed with respect to claim 1 including that the first 
component comprises a media sink (Subramanian et al.: paragraph [0049] - 
media sink - comparing the PTS value with the STC value). 

Regarding claim 3, Subramanian et al. in view of Griffits discloses all the 
limitations as previously discussed with respect to claim 1 including that the 
second component comprises a codec (Subramanian et al.: paragraph [0049] - 
the decoder drops the B-picture therefore, altering the manner in which the 
decoder processes the signal; Griffits: Fig. 2). 

Regarding claim 4, Subramanian et al. in view of Griffits discloses all the 
limitations as previously discussed with respect to claim 1 including that the first 
component comprises a media sink and the second component comprises a 
codec (Subramanian et al.: paragraph [0049] - media sink - comparing the PTS 
value with the STC value; the decoder drops the B-picture therefore, altering the 
manner in which the decoder processes the signal; Griffits: Fig. 2). 
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Regarding claim 7, Subramanian et al .in view of Griffits discloses all the 
limitations as previously discussed with respect to claim 1 including that the 
portion of the presentation comprises a frame (Subramanian et al.: paragraph 
[0049] - one B-picture is a frame; Griffits: Fig. 1 1 - the next sample is altered; 
col. 18, lines 1 1-37 - frames are monitored and once the decoder gets too far 
behind then frames are altered in order to allow the decoder to resynchronize the 
video and audio; col. 18, lines 39-56 - various statistics on the timing of frames 
are monitored; col. 19, lines 11-36 - four situations are determined that include 
frames being too early and too late). 

Regarding claim 8, Subramanian et al. in view of Griffits discloses all the 
limitations as previously discussed with respect to claim 1 including that 
determining whether the two or more samples are processed at the expected 
time comprises comparing a timing value in each of the two or more samples to a 
predetermined time frame associated with the presentation (Subramanian et al.: 
paragraph [0049] - the presentation time stamp for every B-picture is compared 
to the system time clock value; Griffits: Fig. 1 1 - the next sample is altered; col. 
18, lines 1 1-37 - frames are monitored and once the decoder gets too far behind 
then frames are altered in order to allow the decoder to resynchronize the video 
and audio; col. 18, lines 39-56 - various statistics on the timing of frames are 
monitored; col. 19, lines 1 1-36 - four situations are determined that include 
frames being too early and too late). 
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Regarding claim 9, Subramanian et al. discloses all the limitations as 
previously discussed with respect to claim 1 including that determining whether 
the two or more samples are processed at the expected time comprises 
comparing a timing value in each of the two or more samples to a presentation 
clock (Subramanian et al.: paragraph [0049] - the presentation time stamp for 
every B-picture is compared to the system time clock value; Griffits: Fig. 1 1 - the 
next sample is altered; col. 18, lines 11-37 - frames are monitored and once the 
decoder gets too far behind then frames are altered in order to allow the decoder 
to resynchronize the video and audio; col. 18, lines 39-56 - various statistics on 
the timing of frames are monitored; col. 1 9, lines 1 1 -36 - four situations are 
determined that include frames being too early and too late). 

Regarding claim 10, Subramanian et al. in view of Griffits discloses all the 
limitations as previously discussed with respect to claim 1 including that 
determining whether the two or more samples are processed at the expected 
time comprises determining whether a respective timing value in the two or more 
samples was processed by the first component at the time specified by the 
respective timing value (Subramanian et al.: paragraph [0049] - the presentation 
time stamp for every B-picture is compared to the system time clock value; 
Griffits: Fig. 11 - the next sample is altered; col. 18, lines 11 -37 -frames are 
monitored and once the decoder gets too far behind then frames are altered in 
order to allow the decoder to resynchronize the video and audio; col. 18, lines 
39-56 - various statistics on the timing of frames are monitored; col. 19, lines 
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1 1-36 - four situations are determined that include frames being too early and too 
late). 

Regarding claim 11, Subramanian et al. in view of Griffits discloses all the 
limitations as previously discussed with respect to claim 1 including that 
determining whether the two or more samples are processed at the expected 
time comprises determining whether a respective timing value in each of the two 
or more samples was processed by the first component within a given time of a 
time specified by the respective timing value (Subramanian et al.: paragraph 
[0049] - the presentation time stamp for every B-picture is compared to the 
system time clock value; Griffits: Fig. 11 - the next sample is altered; col. 1 8, 
lines 1 1 -37 - frames are monitored and once the decoder gets too far behind 
then frames are altered in order to allow the decoder to resynchronize the video 
and audio; col. 18, lines 39-56 - various statistics on the timing of frames are 
monitored; col. 19, lines 11-36 - four situations are determined that include 
frames being too early and too late). 

Regarding claim 12, Subramanian et al. in view of Griffits discloses all 
the limitations as previously discussed with respect to claim 1 including 
determining whether the two or more samples are processed at the expected 
time comprises determining if the first sample is processed by the first 
component at a first expected time and determining if the second sample is 
processed by the first component at a second expected time (Subramanian et al.: 
paragraph [0049] - the presentation time stamp for every B-picture is compared 
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to the system time clock value and is processed if the PTS value and the STC 
value differ by less than a predetermined threshold; Griffits: Fig. 11 - the next 
sample is altered; col. 18, lines 11 -37 -frames are monitored and once the 
decoder gets too far behind then frames are altered in order to allow the decoder 
to resynchronize the video and audio; col. 18, lines 39-56 - various statistics on 
the timing of frames are monitored; col. 19, lines 1 1-36 - four situations are 
determined that include frames being too early and too late). 

Regarding claim 13, Subramanian et al. in view of Griffits discloses all the 
limitations as previously discussed with respect to claim 1, including determining 
whether the two or more samples are processed at the expected time comprises: 
determining the first timing error as a difference between a time at which the first 
sample is processed by the first component and a time at which the first sample 
is expected to be processed; and determining the second timing error as a 
difference between a time at which the second sample is processed by the first 
component and a time at which the first sample is expected to be processed 
(Subramanian et al.: paragraph [0049] - the presentation time stamp for every B- 
picture is compared to the system time clock value and is processed if the PTS 
value and the STC value differ by less than a predetermined threshold; Griffits: 
Fig. 1 1 - the next sample is altered; col. 1 8, lines 1 1 -37 - frames are monitored 
and once the decoder gets too far behind then frames are altered in order to 
allow the decoder to resynchronize the video and audio; col. 18, lines 39-56 - 
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various statistics on the tinning of frames are monitored; col. 19, lines 1 1-36 - 
four situations are determined that include frames being too early and too late). 

Regarding claim 14, Subramanian et al. in view of Griffits discloses all the 
limitations as previously discussed with respect to claim 1 , including that the first 
sample comprising an associated first timing value and the second sample 
comprises an associated second timing value and wherein determining whether 
the two or more samples are processed at the expected time further comprises 
determining whether the first timing value more closely corresponds to a time at 
which the first sample is processed by the first component than the second timing 
value corresponds to a time at which the second sample is processed by the first 
component (Subramanian et al.: paragraph [0049] - the presentation time stamp 
for every B-picture is compared to the system time clock value and is processed 
if the PTS value and the STC value differ by less than a predetermined threshold; 
Griffits: Fig. 11 - the next sample is altered; col. 18, lines 11-37 - frames are 
monitored and once the decoder gets too far behind then frames are altered in 
order to allow the decoder to resynchronize the video and audio; col. 18, lines 
39-56 - various statistics on the timing of frames are monitored; col. 19, lines 
1 1-36 - four situations are determined that include frames being too early and too 
late). 

Regarding claim 15, Subramanian et al. discloses all the limitations as 
previously discussed with respect to claim 1 including that altering the manner in 
which the second component processes a portion the presentation comprises 
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dropping the at least one succeeding sample (Griffits: Fig. 11 - the next sample 
is altered; col. 18, lines 11-37 - frames are monitored and once the decoder gets 
too far behind then frames are altered in order to allow the decoder to 
resynchronize the video and audio; col. 18, lines 39-56 - various statistics on the 
timing of frames are monitored; col. 19, lines 11-36 - four situations are 
determined that include frames being too early and too late). 

Regarding claim 16, Subramanian et al. in view of Griffits discloses all the 
limitations as previously discussed with respect to claim 1 including that the 
portion of the presentation comprises a plurality of frames, altering the manner in 
which the second component processes the portion of the presentation 
comprises dropping a subset of the plurality of frames, wherein the subset 
comprises two or more frames (Griffits: Fig. 11 - the next sample is altered; col. 
18, lines 1 1-37 - frames are monitored and once the decoder gets too far behind 
then frames are altered in order to allow the decoder to resynchronize the video 
and audio; col. 18, lines 39-56 - various statistics on the timing of frames are 
monitored; col. 19, lines 1 1-36 - four situations are determined that include 
frames being too early and too late). 

Regarding claim 17, Subramanian et al. in view of Griffits discloses all the 
limitations as previously discussed with respect to claim 1 including that the first 
component is a media sink, the second component is a codec, and the wherein 
altering the manner in which the second component processes a portion of the 
presentation comprises dropping at least one frame of the presentation 
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(Subramanian et al.: paragraph [0049] - the presentation time stamp for every B- 
picture is compared to the system time clock value - media sink; if the PTS value 
and the STC value differ by more than a predetermined threshold, the video 
decoder drops the B-picture without decoding; Griffits: Fig. 11 - the next sample 
is altered; col. 18, lines 1 1-37 - frames are monitored and once the decoder gets 
too far behind then frames are altered in order to allow the decoder to 
resynchronize the video and audio; col. 18, lines 39-56 - various statistics on the 
timing of frames are monitored; col. 19, lines 11-36 - four situations are 
determined that include frames being too early and too late). 

Regarding claim 18, Subramanian et al. in view of Griffits discloses all the 
limitations as previously discussed with respect to claim 1 including that the 
pipeline comprises a media source, a media sink, and a topology of media 
processing nodes; the first component is a node in the topology; and the second 
component is the media sink (Subramanian et al.: paragraph [0049] - the 
presentation time stamp for every B-picture is compared to the system time clock 
value - media sink; if the PTS value and the STC value differ by more than a 
predetermined threshold, the video decoder drops the B-picture without 
decoding). 

Regarding claim 19, Subramanian et al. in view of Griffits discloses all 
the limitations as previously discussed with respect to claim 1 including that the 
pipeline comprises a media source, a media sink, and a topology of media 
processing nodes; the first component is a node in the topology including a 
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codec; and the second component is the media sink (Subramanian et al.: 
paragraph [0049] - the presentation time stamp for every B-picture is compared 
to the system time clock value - media sink; if the PTS value and the STC value 
differ by more than a predetermined threshold, the video decoder drops the B- 
picture without decoding). 

Regarding claim 20, Subramanian et al. discloses a method, comprising: 
determining, by a computing device, if timeliness of sample processing in a multi- 
component pipeline is degrading, the determination being made based on 
processing times of a first sample and a second sample, the determination 
comprising calculating a first timing error for the first sample and a second timing 
error for the second sample (paragraph [0049] - the presentation time stamp for 
every B-picture is compared to the system time clock value; thereby meaning 
that two or more samples are processed since every B-picture is sampled and 
each one has its own result); altering, by the computing device, the manner in 
which a component in the multi-component pipeline processes a portion of the 
presentation when the timeliness of the sample processing is determined to be 
degrading (paragraph [0049] - if the PTS value and the STC value differ by more 
than a predetermined threshold, the video decoder drops the B-picture without 
decoding). However, Subramanian et al. fails to disclose comparing the 
processing times of a first sample and a second sample of the presentation and 
wherein the portion comprises one or more succeeding samples to the first and 
second sample. 
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Referring to the Griffits reference, Griffits discloses a method for 
maintaining synchronization between audio and video comprising: determining 
whether at least two sample of a presentation is processed by a first component 
of a pipeline at an expected time; and wherein the second component of the 
pipeline alters the manner in which the second component processes a portion of 
the presentation of the presentation when the two or more samples are not 
processed at the expected time, wherein the portion of the presentation 
comprises at least one succeeding sample to the two or more samples (Fig. 1 1 - 
the next sample is altered; col. 18, lines 11-37 -frames are monitored and once 
the decoder gets too far behind then frames are altered in order to allow the 
decoder to resynchronize the video and audio; col. 18, lines 39-56 - various 
statistics on the timing of frames are monitored; col. 19, lines 11-36 - four 
situations are determined that include frames being too early and too late. 
Furthermore, the first and second samples are being compared in the fact that 
the system is monitoring the process of the decoding and once the frames are 
too early or too late other frames are altered. Griffits discloses both situations of 
the first timing error being greater or less than the second timing error since 
Griffits covers both the fact that frames can be too early and too late). 

Therefore, it would have been obvious to one of ordinary skill in the art at 
the time the invention was made to have altered the succeeding sample in the 
presentation as disclosed by Griffits in the method disclosed by Subramanian et 
al. in order to display the samples at the correct times as well as to maintain a 
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synchronization between audio and video data so that the viewer can not detect 
any problems when synchronizing the video and audio). 

Regarding claim 21 , Subramanian et al. in view of Griffits discloses all the 
limitations as previously discussed with respect to claim 20 including that the 
processing times of the first and the second samples are determined relative to a 
single component in the pipeline (Subramanian et al.: paragraph [0049]; Griffits: 
Fig. 1 1 - the next sample is altered; col. 1 8, lines 1 1 -37 - frames are monitored 
and once the decoder gets too far behind then frames are altered in order to 
allow the decoder to resynchronize the video and audio; col. 18, lines 39-56 - 
various statistics on the timing of frames are monitored; col. 19, lines 1 1-36 - 
four situations are determined that include frames being too early and too late). 

Regarding claim 22, Subramanian et al. in view of Griffits discloses all the 
limitations as previously discussed with respect to claim 20 including that the 
processing times of the first sample is determined relative to a first component in 
the multi-component pipeline and the processing times of the second sample is 
determined relative to a second component in the multi-component pipeline 
(Subramanian et al.: paragraph [0049]; Griffits: Fig. 11 - the next sample is 
altered; col. 18, lines 11 -37 -frames are monitored and once the decoder gets 
too far behind then frames are altered in order to allow the decoder to 
resynchronize the video and audio; col. 18, lines 39-56 - various statistics on the 
timing of frames are monitored; col. 19, lines 11-36 - four situations are 
determined that include frames being too early and too late). 
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Regarding claim 23, Subramanian et al. in view of Griffits discloses all the 
limitations as previously discussed with respect to claim 20 including that the 
processing times of the first and the second samples are determined using timing 
information in the first and second samples (paragraph [0049] - the presentation 
time stamp for every B-picture is compared to the system time clock value; 
Griffits: Fig. 11 - the next sample is altered; col. 18, lines 11-37 - frames are 
monitored and once the decoder gets too far behind then frames are altered in 
order to allow the decoder to resynchronize the video and audio; col. 18, lines 
39-56 - various statistics on the timing of frames are monitored; col. 19, lines 
1 1-36 - four situations are determined that include frames being too early and too 
late). 

Regarding claim 24, Subramanian et al. in view of Griffits discloses all the 
limitations as previously discussed with respect to claim 20 including that the 
processing times of the first and the second samples are determined using timing 
information in the first and second samples and a presentation clock (paragraph 
[0049] - the presentation time stamp for every B-picture is compared to the 
system time clock value; Griffits: Fig. 1 1 - the next sample is altered; col. 18, 
lines 1 1 -37 - frames are monitored and once the decoder gets too far behind 
then frames are altered in order to allow the decoder to resynchronize the video 
and audio; col. 18, lines 39-56 - various statistics on the timing of frames are 
monitored; col. 19, lines 11-36 - four situations are determined that include 
frames being too early and too late). 
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Regarding claim 25, Subramanian et al. in view of Griffits discloses all the 
limitations as previously discussed with respect to claim 20 including that the 
timeliness of the sample processing is determined based on: a first timing 
difference between a time specified in a timing value in the first sample and a 
time that the first sample is processed by the component in the multi-component 
pipeline; a second timing difference between a time specified by a timing value in 
the second sample and a time that the second sample is processed by the 
component in the multi-component pipeline (Subramanian et al.: paragraph 
[0049]; Griffits: Fig. 11 - the next sample is altered; col. 18, lines 11 -37 -frames 
are monitored and once the decoder gets too far behind then frames are altered 
in order to allow the decoder to resynchronize the video and audio; col. 18, lines 
39-56 - various statistics on the timing of frames are monitored; col. 19, lines 
1 1-36 - four situations are determined that include frames being too early and too 
late). 

Regarding claim 26, Subramanian et al. in view of Griffits discloses all the 
limitations as previously discussed with respect to claim 20 including that the 
timeliness of the sample processing is determined based on: the first timing error 
being a difference between a time specified in a timing value in the first sample 
and a time that the first sample is processed by a first component in the multi- 
component pipeline; and the second timing error being a difference between a 
time specified by a timing value in the second sample and a time that the second 
sample is processed by a second component in the multi-component pipeline 
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(Subramanian et al.: paragraph [0049]; Griffits: Fig. 11 - the next sample is 
altered; col. 18, lines 11 -37 -frames are monitored and once the decoder gets 
too far behind then frames are altered in order to allow the decoder to 
resynchronize the video and audio; col. 18, lines 39-56 - various statistics on the 
timing of frames are monitored; col. 19, lines 11-36 - four situations are 
determined that include frames being too early and too late). 

Regarding claim 27, Subramanian et al. in view of Griffits discloses all the 
limitations as previously discussed with respect to claim 20 including that the 
timeliness of the sample processing is determined by: determining the first timing 
error being a difference between a time specified in a timing value in the first 
sample and a time that the first sample is processed by the component in the 
multi-component pipeline; determining the second timing error being a difference 
between a time specified by a timing value in the second sample and a time that 
the second sample is processed by the component in the multi-component 
pipeline, wherein the second sample is processed at a later time than the first 
sample; and determining that timeliness of sample processing is degrading if the 
second timing error is greater than the first timing error (Subramanian et al.: 
paragraph [0049]; Griffits: Fig. 11 - the next sample is altered; col. 18, lines 11- 
37 - frames are monitored and once the decoder gets too far behind then frames 
are altered in order to allow the decoder to resynchronize the video and audio; 
col. 18, lines 39-56 - various statistics on the timing of frames are monitored; 
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col. 19, lines 1 1-36 - four situations are determined that include frames being too 
early and too late). 

Regarding claim 28, Subramanian et al. in view of Griffits discloses all the 
limitations as previously discussed with respect to claim 20 including that the 
timeliness of the sample processing is determined by: determining the first timing 
error being a difference between a time specified in a timing value in the first 
sample and a time that the first sample is processed by a selected component in 
the multi-component pipeline; determining the second timing error being a 
difference between a time specified by a timing value in the second sample and a 
time the second sample is processed by the selected component, wherein the 
second sample is processed at a later time than the first sample; and determining 
that timeliness of sample processing is degrading if the second timing error is 
greater than the first timing error (Subramanian et al.: paragraph [0049]; Griffits: 
Fig. 1 1 - the next sample is altered; col. 1 8, lines 1 1 -37 - frames are monitored 
and once the decoder gets too far behind then frames are altered in order to 
allow the decoder to resynchronize the video and audio; col. 18, lines 39-56 - 
various statistics on the timing of frames are monitored; col. 19, lines 1 1-36 - 
four situations are determined that include frames being too early and too late). 

Regarding claim 29, Subramanian et al. in view of Griffits discloses all the 
limitations as previously discussed with respect to claim 20 including that altering 
the manner in which the component in the multi-component pipeline processes a 
portion of the presentation comprises instructing the component to drop the one 
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or more succeeding samples (Griffits: Fig. 11 - the next sample is altered; col. 
18, lines 1 1-37 - frames are monitored and once the decoder gets too far behind 
then frames are altered in order to allow the decoder to resynchronize the video 
and audio; col. 1 8, lines 39-56 - various statistics on the timing of frames are 
monitored; col. 19, lines 11-36 - four situations are determined that include 
frames being too early and too late). 

Regarding claim 30, Subramanian et al. in view of Griffits discloses all the 
limitations as previously discussed with respect to claim 20 including that altering 
the manner in which the component in the multi-component pipeline processes 
the portion of the presentation comprises instructing the component to drop each 
sample in a frame of the presentation (Subramanian et al.: paragraph [0049] - if 
the PTS value and the STC value differ by more than a predetermined threshold, 
the video decoder drops the B-picture without decoding; Griffits: Fig. 11 - the 
next sample is altered; col. 18, lines 1 1-37 - frames are monitored and once the 
decoder gets too far behind then frames are altered in order to allow the decoder 
to resynchronize the video and audio; col. 18, lines 39-56 - various statistics on 
the timing of frames are monitored; col. 19, lines 1 1-36 - four situations are 
determined that include frames being too early and too late). 

Regarding claim 31 , Subramanian et al. in view of Griffits discloses all the 
limitations as previously discussed with respect to claim 20 including that each 
component comprises processor executable instructions executed by a 
processor (Subramanian et al.: Fig. 2). 
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Regarding claims 32-41, these are apparatus claims corresponding to the 
method claims 1-4, 13-17, and 20. Therefore, claims 32-41 are analyzed and 
rejected as previously discussed with respect to claims 1-4, 13-17, and 20. 

Regarding claims 42-46, these are computer-readable medium claims 
corresponding to the method claims 1-4, 8, 15, and 20. Therefore, claims 42-46 
are analyzed and rejected as previously discussed with respect to claims 1-4, 8, 
15, and 20. Furthermore, Subramanian et al. comprises processor executable 
instructions executed by a processor (Fig. 2). 

Regarding claims 47-51, these are computer-readable medium claims 
corresponding to the method claims 1-4, 8, 13, and 15. Therefore, claims 47-51 
are analyzed and rejected as previously discussed with respect to claims 1-4, 8, 
13, and 15. 

Regarding claim 52, Subramanian et al. in view of Griffits discloses all 
the limitations as previously discussed with respect to claim 1 including that the 
portion of the presentation comprises a third sample and a fourth sample (Griffits: 
Fig. 1 1 - the next sample is altered; col. 1 8, lines 1 1 -37 - frames are monitored 
and once the decoder gets too far behind then frames are altered in order to 
allow the decoder to resynchronize the video and audio; col. 18, lines 39-56 - 
various statistics on the timing of frames are monitored; col. 19, lines 1 1-36 - 
four situations are determined that include frames being too early and too late). 

Regarding claim 53, Subramanian et al. in view of Griffits discloses all the 
limitations as previously discussed with respect to claims 1 and 13, including that 
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the method further comprises: if the second timing error is greater than the first 
timing error, further requesting the second component of the pipeline to alter the 
manner in which the second component processes the portion of the 
presentation, wherein the portion of the presentation comprises two or more 
succeeding samples to the at least one sample (Griffits: Fig. 1 1 - the next 
sample is altered; col. 18, lines 11 -37 -frames are monitored and once the 
decoder gets too far behind then frames are altered in order to allow the decoder 
to resynchronize the video and audio; col. 18, lines 39-56 - various statistics on 
the timing of frames are monitored; col. 19, lines 11-36 - four situations are 
determined that include frames being too early and too late). 

Regarding claim 54, Subramanian et al. in view of Griffits discloses all the 
limitations as previously discussed with respect to claims 1,13, and 53 including 
that the two or more succeeding samples to the at least one sample are not 
consecutive samples (Griffits: Fig. 1 1 , step 475 - all B frames are dropped 
regardless of where they are). 

Regarding claim 55, Subramanian et al. in view of Griffits discloses all the 
limitations as previously discussed with respect to claim 20 including that the 
portion of the presentation comprises a third sample and a fourth sample (Griffits: 
Fig. 11 - the next sample is altered; col. 1 8, lines 1 1 -37 - frames are monitored 
and once the decoder gets too far behind then frames are altered in order to 
allow the decoder to resynchronize the video and audio; col. 18, lines 39-56 - 
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various statistics on the timing of frames are monitored; col. 19, lines 11-36 - 
four situations are determined that include frames being too early and too late). 

Regarding claim 56, Subramanian et al. in view of Griffits discloses all the 
limitations as previously discussed with respect to claims 20 and 28 including 
that the method further comprises: if the timeliness of the sample processing is 
said determined to be degrading, further altering the manner in which the 
component processes the portion of the presentation, wherein the portion of the 
presentation comprises two or more succeeding samples to one or more of the 
first sample and the second sample (Griffits: Fig. 1 1 - the next sample is altered; 
col. 18, lines 1 1-37 - frames are monitored and once the decoder gets too far 
behind then frames are altered in order to allow the decoder to resynchronize the 
video and audio; col. 18, lines 39-56 - various statistics on the timing of frames 
are monitored; col. 19, lines 11-36 - four situations are determined that include 
frames being too early and too late). 

Regarding claim 57, Subramanian et al. in view of Griffits discloses all the 
limitations as previously discussed with respect to claims 20, 28, and 56 
including that the two or more succeeding samples to the at least one sample are 
not consecutive samples (Griffits: Fig. 1 1 , step 475 - all B frames are dropped 
regardless of where they are). 
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Conclusion 

5. The prior art made of record and not relied upon is considered pertinent to 

applicant's disclosure. 

a. Poimboeuf et al. (U.S. Patent 5,764,965) discloses a first timing signal is 
compared with the system clock to establish a reference. Likewise, the second 
signal (e.g., audio samples) could be compared with this same system clock to 
determine its reference. By comparing these two references, it is possible to 
determine whether the second signal (e.g., audio samples) are aligned with, 
ahead, or behind in time with respect to the first timing signal (e.g., video 
stream). Furthermore, one can determine whether the second signal (e.g., 
audio samples) is running faster, slower, or at the same rate as the first timing 
signal (e.g., video stream) by comparing their references over a period of time. 

Any inquiry concerning this communication or earlier communications from the 
examiner should be directed to HEATHER R. JONES whose telephone number is 
(571 )272-7368. The examiner can normally be reached on Mon. - Thurs.: 7:00 am - 
4:30 pm, and every other Fri.: 7:00 am - 3:30 pm. 

If attempts to reach the examiner by telephone are unsuccessful, the examiner's 
supervisor, Thai Tran can be reached on 571-272-7382. The fax phone number for the 
organization where this application or proceeding is assigned is 571-273-8300. 

Information regarding the status of an application may be obtained from the 
Patent Application Information Retrieval (PAIR) system. Status information for 
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published applications may be obtained from either Private PAIR or Public PAIR. 
Status information for unpublished applications is available through Private PAIR only. 
For more information about the PAIR system, see http://pair-direct.uspto.gov. Should 
you have questions on access to the Private PAIR system, contact the Electronic 
Business Center (EBC) at 866-217-9197 (toll-free). If you would like assistance from a 
USPTO Customer Service Representative or access to the automated information 
system, call 800-786-9199 (IN USA OR CANADA) or 571-272-1000. 

Heather R Jones 
Examiner 
Art Unit 2621 

HRJ 

September 10, 2009 
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Supervisory Patent Examiner, Art Unit 2621 



